Superfluid and insulating phases of fermion mixtures in optical lattices 
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The ground state phase diagram of fermion mixtures in optical lattices is analyzed as a function 
of interaction strength, fermion filling factor and tunneling parameters. In addition to standard 
superfluid, phase-separated or coexisting superfluid/excess-fermion phases found in homogeneous or 
harmonically trapped systems, fermions in optical lattices have several insulating phases, including 
a molecular Bose-Mott insulator (BMI), a Fermi-Pauli (band) insulator (FPI), a phase-separated 
BMI/FPI mixture or a Bose- Fermi checkerboard (BFC). The molecular BMI phase is the fermion 
mixture counterpart of the atomic BMI found in atomic Bose systems, the BFC or BMI/FPI phases 
exist in Bose-Fermi mixtures, and lastly the FPI phase is particular to the Fermi nature of the 
constituent atoms of the mixture. 



PACS numbers: 03.75.Ss, 03.75.Hh, 05.30.Fk 



Ultra-cold atoms in optical lattices are ideal systems 
to study novel condensed matter phases. The study of 
Bose atoms in optical lattices has revealed (in addition to 
superfluid phases) an atomic Bose-Mott insulator (BMI) 
phase [l[ . Eventhough great success was achieved in cool- 
ing and studying Bose atoms in optical traps, it was not 
until very recently that Fermi atoms (mixtures of two- 
hyperfine states) [2} or mixtures of Bose and Fermi atoms 
were sucessfully loaded into optical lattices In ad- 
dition, several groups around the world are attempting 
to create mixtures of two types of fermions, as it was 
achieved with two types of bosons 0] ■ 

In a very recent paper the MIT group produced pre- 
liminary experimental evidence for superfluid and insu- 
lating phases of ultracold 6 Li atoms in optical lattices Q . 
This last experiment overcame some earlier difficulties of 
producing Fermi superfluids from an atomic Fermi gas or 
from molecules of Fermi atoms in optical lattices 0] • 
Unlike in homogeneous or harmonically trapped systems, 
optical lattices offer an enormous degree of control since 
phase diagrams may be studied as a function of tunnel- 
ing matrix element t a between adjacent lattice sites, on- 
site atom-atom interactions g, filling fraction n a , lattice 
dimensionality T> and tunneling anisotropy rj — ti/tf, 
where a labels the type of fermion state. 

The research explosion that followed successful loading 
of bosons in optical lattices and the observation of Bose- 
Mott phases [8( almost guarantees a priori another re- 
search explosion following successful loading of fermions 
in optical lattices and the observation of superfluid and 
insulating phases in particular because fermions are 
more "fundamental" particles of atomic and condensed 
matter systems in the sense that they can lead to Bose- 
like behavior (Bose molecules made of two-fermions) and 
to combined Bose-Fermi behavior when there are Bose 
molecules and unbound excess fermions. Thus, the re- 
sulting quantum phases of Fermi mixtures is much richer 
than those present in systems consisting of atomic bosons 
or Bose-Fermi mixtures in optical lattices. Arguably, 



mixtures of two-hyperfine-states of the same type of 
fermion or mixtures of two different types of fermions 
loaded into optical lattices are one of the next frontiers 
in ultracold atom research because of their greater tun- 
ability and the richness of their phase diagrams. 

Our main results are as follows. Using an attractive 
Fermi-Hubbard Hamiltonian to describe fermion mix- 
tures in optical lattices, we obtain the ground state phase 
diagram containing normal, phase-separated and coexist- 
ing superfluid/excess-fermions, and insulating regions as 
a function of interaction strength and density of fermions. 
We show that when fermion-fermion (Bose) molecules are 
formed they interact with each other strongly and re- 
pulsively. Furthermore, when there are excess fermions, 
the resulting system corresponds to a strongly interacting 
(repulsive) mixture of bosons and fermions in the molec- 
ular limit, in sharp contrast with homogenous systems 
where the resulting Bose-Fermi mixtures are weakly in- 
teracting 0] . This result is a direct manifestation of the 
Pauli exclusion principle in the lattice case, since each 
Bose molecule consists of two fermions, and more than 
one identical fermion on the same lattice site is not al- 
lowed. Lastly, several insulating phases appear in the 
strong attraction limit depending on the fermion filling 
fractions. For instance, we find a molecular Bose-Mott 
insulator (superfluid) when the molecular filling fraction 
is equal to (less than) one when the fermion filling frac- 
tions are identical in qualitative agreement with the MIT 
experiment [2|j. Furthermore, when the filling fraction of 
one type of fermion is one and the filling fraction of the 
other is one-half (corresponding to molecular boson and 
excess fermion filling fractions of one- half), we also find 
either a phase-separated state consisting of a Fermi-Pauli 
insulator (FPI) of the excess fermions and a molecular 
Bose-Mott insulator (BMI) or a Bose-Fermi checkerboard 
(BFC) phase depending on the tunneling anisotropy rj. 
Finally, we propose that all these superfluid and insulat- 
ing phases can be observed in mixtures of fermions loaded 
into optical lattices. 
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Lattice Hamiltonian: To describe mixtures of fermions 
loaded into optical lattices, we start with a single-band 
Fermi-Hubbard Hamiltonian in momentum space 



k,<r 
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/ j k.q.cr 
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&l „ _&k',q,<T, 



(1) 



with an on-site attractive interaction g > 0. Here, the 
pseudo-spin a labels the trapped hyperfine states of a 
given species of fermions, or labels different types of 
fermions in a two-species mixture, where a k is the cre- 
ation operator andj4 q>CT = a k+q/2 , CT at -k+q/2,-^ In addi- 
tion, £k.(T = £k,o-— AV describes the nearest neighbor tight- 
binding dispersion ek )Cr = 2t a 9^ with = — Vh,<t and 
#k = yi-[l — cos(fcja c )], where i CT is the tunclling matrix 
element, /v is the chemical potential, Vh,<t is a possi- 
ble Hartree energy shift and a c is the lattice spacing. 
Notice that, we allow fermions to be of different species 
through t a , and to have different populations controlled 
by independent Jl a - Furthermore, unlike recent work of 
BCS pairing of fermions in optical lattices [13, U|, we 
discuss the evolution from BCS to BEC pairing and the 
emergence of insulating phases. We ignore multi-band 
effects since a single-band Hamiltonian may be sufficient 
to describe the evolution from BCS to BEC physics in 
optical lattices [liL Il3j |. However, these effects can be 
easily incorporated into our theory. 

For the Hamiltonian given in Eq. (fT]), the saddle point 
order parameter equation is given by 
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where M is the number of lattice sites, f(x) = 
l/[exp(x/T) + 1] is the Fermi function, E^ a = + 

| Ao| 2 ) 1 / 2 +s cr ^k,- is the quasiparticle energy when S| = 1 
or the negative of the quasihole energy when s± = —1, 
and B k ,± = O^M ^ ^k,i)/2- Here, A is the order pa- 
rameter and £k,± = e k.± — M±, where £k.± = 2i±#k with 
t± = (*T ^ )/2 and jl± = ± M;)/2. Notice that, the 
symmetry between quasiparticles and quasiholes is bro- 
ken when £k.- 7^ 0. The order parameter equation has 
to be solved self-consistently with number equations 



N„ = J2 [l"k| 2 /(^k„ 

k 



M 2 /(-£k,-.)] , (3) 



where |u k | 2 = (1 + &, + /£fc 1+ )/2 and |w k | 2 = (1 - 
^k.+/£ ; k.+)/2. The number of <r-type fermions per lat- 
tice site is given by < n a — N a /M < 1. Thus, when 
n-f 7^ n^, we need to solve all three self-consistency equa- 
tions, since population imbalance is achieved when either 
i?k,t or ^ is negative in some regions of momentum 
space, as discussed next. 

Ground state saddle point phase diagrams: To obtain 
ground state phase diagrams, we solve Eqs. © and © 



as a function of interaction strength g, population imbal- 
ance — I < P = (n-f — rij)/(ri| + ni) < 1 and total filling 
fraction < F = (n-f +nj)/2 < 1, for two sets of tunnel- 
ing ratios n = ti/t^. The case of r\ = 1 (t a = t) is shown 
in Fig. [H and the case of 77 = 0.15 is not shown. While 
n = 1 corresponds to one-species (two-hyperfine-state) 
mixture such as 6 Li or 40 K, n = 0.15 corresponds to a 
two-species mixture (one-hyperfine-state of each type of 
atom) such as 6 Li and 40 K. 




FIG. 1: (a) ri| versus nj,, and (b) P versus F diagrams 
for g = 5t and g = Wt. The normal regions (outside 
the "football") and coexistence of superfluidity with excess 
fermions (CSE) and/or phase separation (PS) (inside the 
"football") are indicated. The CSE/PS (normal) region ex- 
pands (shrinks) with increasing attraction. 

In the phase diagrams shown in Fig. [TJ we indicate 
the regions of normal (N) phase where |Ao| = 0, and 
group together the regions of coexistence of superfluid- 
ity and excess fermions (CSE) and/or phase separation 
(PS), where |A | 7^ 0. When F<1, the phase diagrams 
are similar to the homogenous case [TBI, 16 1, and the P 
versus F phase diagram is symmetric for equal tunnclings 
as shown in Fig. [TJ and is asymmetric for unequal tun- 
nelings having a smaller normal region when the lighter 
band mass fermions are in excess (not shown) fl7j | . Here, 
we do not discuss separately the CSE and PS regions 
since they have already been discussed in homogeneous 
and harmonically t rapp ed systems 15, [l6j], and exper- 
imentally observed |l8l. Il9j|. but we make two remarks. 
First, the phase diagram characterized by normal, non- 
normal (CSE or PS), and insulating regions may be ex- 
plored experimentally by tuning the ratio g/t + , total fill- 
ing fraction F, and population imbalance P as done in 
harmonic traps Second, topological phases char- 

acterized by the number (I and II) of simply connected 
zero-energy surfaces of E^ a may lie in the stable region 
of CSE, unlike in the homogeneous case where the topo- 
logical phase II always lies in the phase separated region 
for all parameter space |20| . 

We would like to emphasize that the saddle point ap- 
proximation only tells us that the system is either super- 
fluid (|A | 7^ 0) or normal (|A | =0), but fails to tells us 
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about insulating phases. Thus, first, we present a physi- 
cal discussion of the emergence of insulating phases, and 
then show that these phases indeed emerge from fluctu- 
ation effects beyond the saddle point approximation. 

Emergence of Insulating Phases. Generally lines AB 
(0 < n T < 1; ni = 0) and ED (n T = 0; < n l < 1) 
in Fig. [T] correspond to normal cr-type Fermi gases for all 
interactions, while points B (rif = 1, 7ij =0) and D (n^ — 
0, rij = 1) correspond to a Fermi-Pauli (band) insulator 
since there is only one type of fermion in a fully occupied 
band. Thus, the only option for additional fermions (| 
in case B and j in case D) is to start filling higher energy 
bands if the optical potential supports it, otherwise the 
extra fermions are not trapped. For the case where no 
additional bands are occupied we label the corresponding 
phase diagram regions as 'Inaccessible' in Fig.QJb), since 
either n-\ > 1 or > 1 in these regions. 

In addition, the population balanced line AC ends at 
the special point C, where n-\ — = 1. This point is 
a Fermi-Pauli (band) insulator for weak attraction since 
both fermion bands are fully occupied, and a Bose-Mott 
Insulator (BMI) in the strong attraction limit, since at 
each lattice site there is exactly one molecular boson 
(consisting of a pair of f and J, fermions) which has a 
strong repulsive on-site interaction with any additional 
molecular boson due to the Pauli exclusion principle. 

Furthermore, for very weak fermion attraction, lines 
BC (ra T = 1,0 < n; < 1) and CD (0 < n T < l,n l = 1) 
correspond essentially to a fully polarized ferromagnetic 
metal (or half- metal), where only the fermion with fill- 
ing fraction less than one can move around. However, 
when the fermion attraction is sufficiently strong the 
lines BC and CD must describe insulators, as molecu- 
lar bosons and excess fermions are strongly repulsive due 
to the Pauli exclusion principle. The crosses in Fig. [1] at 
points n-f = l,7ij = 1/2 or n-\ — 1/2, = 1 indicate the 
case where the molecular boson filling fraction n B = 1/2 
and the excess fermion filling fraction is n e — 1/2. At 
these high symmetry points, molecular bosons and excess 
fermions tend to segregate, either producing a domain 
wall type of phase separation with a molecular Bose-Mott 
insulator (BMI) and a Fermi-Pauli insulator (FPI) region 
or a checkerboard phase of alternating molecular bosons 
and excess fermions (BFC). A schematic diagram of these 
two phases is shown in Fig. [2a). 

Thus, the strong attraction limit in optical lattices 
brings additional physics not captured at the saddle point 
and not present in homogenous or purely harmonically 
trapped systems, as discussed next. 

Strong attraction (molecular) limit: The emergence 
of insulating phases in the strong attraction attraction 
limit requires the simultaneous inclusion of spatial and 
temporal fluctuations. Thus, first, we derive a time 
dependent Ginzburg-Landau theory involving molecu- 
lar bosons and excess fermions near the critical tem- 
perature T c of the possible supcrfluid phase leading to 
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FIG. 2: (Color online) (a) schematic diagram for the BFC 
phase (top) and BMI/FPI phase separation (bottom), and 
(b) Vbb versus Vbf phase diagram. 



[a+b\A{x)\ 2 -cW 2 /2-id(d/dt)]A(x) = in the a; = (x,t) 
representation. Here, A(x) is the fluctuation of the order 
parameter around its saddle point value |Ao| = 0. 

In the strong attraction (molecular) limit f=a 
|e(,|(l — _p e )/2 3> 2T>t + , we obtain a = a\ + a 2 — 

-[2/1+ - e b (l - Pe )]/[g 2 (l - Pe)] + Pe/W - Pe)}, b = 



r.2/ 



Pe 



b l + b 2 = 2/[. 9 3 (l - p e f 

c = Aal^tJ[g 3 {l - p e ) 2 }, and d = 1/[<? 2 (1 - p e ,. 
Here, €/, = — g is the binding energy defined by 1/g — 
^ k l/(2ek,+ — efc), and e (— e) labels the excess (non- 
excess) type of fermions and p e — | nj — | is the number 
of unpaired fermions per lattice site. 

Through the rescaling ty(x) = \/dA(x), we obtain the 
equation of motion for a mixture of bound pairs (molec- 
ular bosons) and unpaired (excess) fermions 



Lt B *(x) + [U BB \t>(x)\ 2 + U BFPe (x)] *(x) 



V 2 *(a;) 



2m B 



dt 



= o, 



(4) 



with pair chemical potential [i B = —a\jd = 2pt + — 
£b(l — p e ), mass m B = d/c = g / '(Aa 2 t^t j) , and repul- 
sive pair-pair U BB = b\a? c jd 2 = 2ga\ and pair- fermion 
Ubf = 0,20^1 '(dp e ) = ga^ interactions. This proce- 
dure also yields p e {x) — [a 2 /d + b 2 \^{x)\ 2 /d 2 ]/U B F — 
p e — ga? c (dp e /d^ e ){\ ~ p e )\^{x)\ 2 > 0, which is the spa- 
tial density of unpaired fermions. In contrast with the ho- 
mogeneous or harmonically trapped systems 0, [2(| , the 
boson-boson and boson-fermion interactions are strongly 
repulsive due to the important role played by the Pauli 
exclusion principle in the lattice, which is discussed next. 

Effective lattice Bose-Fermi action: In the limit of 
strong attractions between fermions g/t + 3> 1, we ob- 
tain an effective Bose-Fermi lattice action 



S B f — 



dr 



E 



(fjdrfi + btdrb^+H^ 



(5) 



where H e Jp 



A + K B + H BF + H BB . Here, K F = 
^fY.i fifi - *FZ)<i,j) fifj is the kinetic part of the 
excess fermions; K B = -fi B Y,ib\bi ~ ^E^j^j 
is the kinetic part of the molecular bosons; H B p — 
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Ubf^Zi fl fib\bi is the interaction between molecular 
bosons and excess fermions; and Hbb = Ubb J2i b\bib\bi 
is the interaction between two molecular bosons. 

The total number of fermions is fixed by the con- 
straint ri = 2hb + p e , where ns — Nb/M is the num- 
ber of bosons per lattice site. The important parame- 
ters of this effective Hamiltonian are the excess fermion 
transfer energy tp = t e , the molecular boson transfer 
energy ts — 2t-\ti/g, the boson-fermion effective repul- 
sion Ubf — 9 and the boson-boson effective repulsion 
Ubb = 2g. Notice that, on-site interactions Ubb and 
Ubf become infinite (hard-core) when g — > oo as a man- 
ifestation of the Pauli exclusion principle. In addition, 
there are weak and repulsive nearest neighbor boson- 
boson Vbb oc (i| + 1|)/<7 and boson-fermion Vbfoc t\/g 
interactions. These repulsive interactions in optical lat- 
tices lead to several insulating phases, depending on 
fermion filling fractions. In the following analysis, we 
discuss only two high symmetry cases: (a) n-f = n^; and 
(b) n-j- = 1 and nj. = 1/2 or n-f = 1/2 and nj. = 1. 
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FIG. 3: (Color online) n-\ versus phase diagram in the 
strong attraction limit, indicating the CSE (superfluid), the 
metallic (lines AB and DE), and insulating (lines BC and CD) 
phases with special points FPI, BFC, BMI/FPI, and BMI. 

In case (a) indicated as point C in Figs. Q] and [3] 
where p e = 0, Hbf reduces to a molecular Bose- 
Hubbard Hamiltonian with the molecular Bose filling 
fraction jib — n/2 — F, thus leading to a molecular 
BMI when ns — 1 beyond a critical value of Ubb- The 
critical value U BB needed to attain the BMI phase can 



be estimated using the approach of Ref. 14J leading to 



U BB = 3(3 + \/%)tB, which in terms of the underlying 
fermion parameters leads to g c = 4.18y / t|tJ for the crit- 
ical fermion interaction. This value of g c is just a lower 
bound of the superfluid-to-insulator (SI) transition, since 
H B p is only valid in the g 3> £+ limit. This SI transition 
at g c has been observed in recent experiments Q. 

In case (b) indicated as crosses in Figs. Q] and El 
the ground state of the effective molecular-boson/excess- 
fermion system corresponds to either a checkerboard 
phase of alternating bosons and fermions or to a phase 
separated BMI/FPI system depending on the ratio 
Vbb /Vbf- The checkerboard phase shown in Fig [21(a) 
is favored when Vbb > 2Vbf, leading to the phase di- 
agram of Fig. [U(b). At the current level of approxima- 



tion, we find that when t-\ — ij, phase separation is al- 
ways favored, however when ] (!) fermions are in ex- 
cess the checkerboard phase is favored when t± > v^T 
(tj < <|/\/3)- Therefore, phase separation and checker- 
board phases are achievable if the tunneling ratio g can be 
controlled experimentally in optical lattices. Notice that 
this checkerboard phase present in the lattice case is com- 
pletely absent in homogeneous or harmonically trapped 
systems 15, [1(3, l20j . Furthermore, the entire lines BC 
and CD in Fig. 3 represent insulating phases. 

Conclusions: We have analyzed the ground state 
phase diagram of fermion mixtures in optical lattices as 
a function of interaction strength, fermion filling fac- 
tor, and tunneling parameters. In addition to stan- 
dard superfluid, phase separated or coexisting super- 
fluid/excess fermion phases, we have found several in- 
sulating phases including a molecular Bose-Mott insula- 
tor (BMI), a Fermi-Pauli (band) insulator (FPI), a phase 
separated BMI/FPI mixture, and a Bose-Fermi checker- 
board phase depending on fermion filling fractions. All 
these additional phases make the physics of Fermi mix- 
tures much richer than those of atomic bosons or Bose- 
Fermi mixtures in optical lattices, and of harmonically 
trapped fermions. Lastly, the molecular BMI phase dis- 
cussed here has been preliminarily observed in a very 
recent MIT experiment 0, opening up the experimental 
exploration of the rich phase diagram of fermion mix- 
tures in optical lattices in the near future. We thank 
NSF (DMR-0304380) for support. 
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